🕷️️ Job Radar • SCRAPING

upwork.com 2026-04-30 🟡

🔹 Web Crawling Expert Required
👤 Client: 🇰🇷 South Korea Member since 2026-04-29
💰 Price: ****
🚩 Problem: Extract structured data from multiple websites for research project.
📦 Existing: Not specified

Specifications:

[Target] Define target websites and data points to be extracted.
[Method] Develop web crawlers using Python with libraries like Scrapy or BeautifulSoup.
[UI/UX] Not applicable (backend task).
[Stack] Python, Scrapy, BeautifulSoup, Selenium, Pandas, JSON.
[Security] Implement rate limiting and user-agent rotation to avoid detection. Ensure data privacy compliance.
[Format] Export extracted data in structured JSON format.

Workflow:

Analyze project requirements to identify target websites and specific data points.
Design web crawlers using Python with Scrapy or BeautifulSoup for efficient data extraction.
Implement rate limiting, user-agent rotation, and other anti-detection measures.
Test crawlers on a subset of the target websites to ensure reliability and accuracy.
Extract data from all target websites and validate against project requirements.
Export extracted data in structured JSON format for further analysis.